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Abstract: How is it that entropy derivatives almost in their own are character- 
izing the state of a system close to equilibrium, and what happens further away 
from it? We explain within the framework of Markov jump processes why fluc- 
tuation theory can be based on considerations involving entropy production alone 
when perturbing around the detailed balance condition. Variational principles such 
as that of minimum entropy production are understood in that way. Yet, further 
away from equilibrium, dynamical fluctuations reveal a structure where the time- 
symmetric sector crucially enters. The fluctuations of densities and currents get 
coupled and a time-symmetric notion of dynamical activity becomes the counter- 
part and equal player to the entropy production. The results are summarized in 
an extended Onsager-Machlup Lagrangian, which in its quadratic approximation is 
expected to be quite general in governing the small fluctuations of nonequilibrium 
systems whose macroscopic behavior can be written in terms of a Master equation 
autonomously describing the time-dependence of densities and currents. 



1. Scope 

The breaking of time-reversal symmetry is certainly an important 
feature of nonequilibrium systems. While the underlying microscopic 
dynamics is (under usual circumstances) time-reversal symmetric, the 
plausibility of the time-reversed history of mesoscopic or even more 
macroscopic conditions can greatly differ from that of the original his- 
tory. These considerations are very much linked with the concept of 
entropy and its production. As written by Max Planck in 1926 [2U] : 
"...there is no other general measure for the irreversibility of a pro- 
cess than the amount of increase of entropy. " As an example, the by 
now well-known fluctuation symmetries of the entropy production, be 
it transient or in the steady state, are on a formal level nothing but ex- 
pressions of that relation between entropy production and time-reversal 
breaking. That point was especially emphasized in [3], |T21 [13] • 
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In particular and even if not always explicit, much emphasis in the 
study of nonequilibrium phenomena has gone to the study of the en- 
tropy production, or to some nonequilibrium extension and general- 
ization of thermodynamic potentials. Nevertheless there are reasons to 
doubt the unique relevance of the entropy production concept, as tradi- 
tionally understood, in far from equilibrium set-ups. Similar thoughts 
have already been expressed longer time ago in [TT]. The characteri- 
zation of nonequilibrium could very well require to consider observa- 
tions that are somewhat foreign to equilibrium thermodynamics. En- 
tropy production governs equilibrium fluctuations and remains use- 
ful for close-to-equilibrium processes via the concept of heterogeneous 
equilibrium. Yet, that hydrodynamic experience is mostly related to 
the problem of return to equilibrium. For all we can imagine, perhaps 
other quantities must complement the entropy production to account 
for other relevant nonequilibrium features that have to do not only 
with dissipation but perhaps also with more constructive aspects of 
the nonequilibrium kinetics and its dynamical activity. 

We are interested here in the fluctuation functionals for the nonequi- 
librium statistics of state-occupations and of state-transitions. Much 
research into this has already been done, and for a review of this we 
refer to [1]. Our emphasis lies on the joint fluctuations of these time- 
symmetric and time-antisymmetric sectors of the dynamical fluctua- 
tions. The most important observations will be, that these sectors are 
coupled and that they are not solely determined by the stationary en- 
tropy production. A similar emphasis was put already in the treatment 
of the steady state statistics of diffusions, [IB] , and in the elucidation 
of a canonical structure of the steady fluctuations [12]. Here we are 
adding the discussion on the transient regime and for the steady state 
we concentrate fully on the small fluctuations around the stationary 
values. That suffices to appreciate the appearance of a new quantity, 
that we have called traffic and that measures the dynamical activity in 
a time-symmetric way. 

The type of nonequilibrium systems to which we believe our analysis 
applies almost literally are composed of weakly interacting particles, as 
in a driven dilute gas for which a Boltzmann-Grad limit can be taken, or 
as in a driven Lorentz gas, or consist of a multi-level system in contact 
with particle or heat reservoirs. The latter are frequently encountered 
in quantum transport systems on the nanoscale. When dealing with 
interacting particles, we would think that the line of analysis can be 
kept but interesting new behavior, including phase transitions, can re- 
sult and be accompanied by a less trivial application of the theory of 
large deviations. We refer to [7] and references therein for an update. 
The text is not a fully mathematical treatment. Our excuse is that we 
think more important today to put the physical concepts in place and to 
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suggest a fruitful line of physical reasoning. Moreover, the mathemat- 
ical formulation and proofs are expected to be rather straightforward, 
and not adding substantially to the interest of the paper. Nevertheless, 
we realize that the paper can still appear a bit heavy on the formal side; 
no standard examples are included from the recent nonequilibrium lit- 
erature. We hope that future contributions will remedy that. 

The next section presents the set-up; the particular framework is 
that of Markov jump processes to be used as start for a nonequilibrium 
thermodynamics of free particles. Section [3] reminds us of the notion 
of entropy production. A separate section H] is devoted to the notion 
of dynamical fluctuations. The rest of the paper analyzes the resulting 
generalized Onsager-Machlup Lagrangian, first around equilibrium in 
Section 15.11 and then for more arbitrary nonequilibrium conditions in 
Section 15. 2[ 

2. Set-up 

Imagine a large number of degrees of freedom {x], . . . , xf^) evolving 
in continuous time t. The case we consider is that of a collection of jump 
processes, with a common state space Q. On the level of a macroscopic 
description, two types of empirical averages present themselves: first, 

1 ^ 

fc=i 

where the indicator function x, possibly understood in a distributional 
sense, gives the state-occupation. Secondly, there is the empirical dis- 
tribution of jumps X — >• y for all pairs of states x,y E fl, that we write 
in the form 

^#{jumps X -^y within [t,t + r]} = rp^ {x)k^ {x,y) + o(r) (2.2) 

where we have already expressed the assumption that these suffice for 
an autonomous description. In other words, the and k'^ are not 
completely arbitrary but they have to satisfy the consistency (or bal- 
ance) relation 



= J2iPtiy)kriy,^) -pf (x)fcf (x,y)} (2.3) 

One recognizes in (12. 3p the form of a Master equation. It is one of 
the challenges of nonequilibrium statistical mechanics to actually ob- 
tain useful conditions on the derivation of such Master equations from 
more microscopic evolution laws. Here we ignore that problem and we 
actually start from the collection of independent and identical 

Markov jump processes. To make it even simpler, we assume that Q is 
finite and that the process (xj) is ergodic with unique stationary law 
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p. All that is believed not to be extremely important, as we have in 
mind the N f +00 limit. The possibility of phase-transitions or of 
non-smooth behavior is not considered here in exchange for a thorough 
look at the fluctuation theory of the {pf^ kf)t and derived quantities. 

2.1. Macroscopic limit. We consider a collection of identical inde- 
pendent ergodic continuous time Markov processes x], each taking val- 
ues in the finite state space Q and with rates X{x,y) > for jumps 
between the states x —>■ y. We interpret the process {xl)t as the ran- 
dom trajectory of the i-th particle, where randomness refers to some 
reduced description where further degrees of freedom are integrated 
out possibly in combination with some particular limiting procedure. 
On the macroscopic level, we deal with the trajectory {p^ , k^)t from 
(12. ip and (12. 2p . It defines the whole empirical process which is (time- 
inhomogeneous) Markov even for finite by construction; note that 
we do not include three- and higher-time empirical correlations into 
our macroscopic description. From the law of large numbers, the ran- 
dom occupations {p^)t concentrate in the limit — >■ 00 on the unique 
solution of the Master equation 

= Y.^Vt{y)Ky. ^) - Ptix)\ix, y)} (2.4) 

2.2. Path distribution. The trajectories of the particle do not all 
have the same probability. And the same trajectory has different prob- 
abilities depending on the rates of the process. All that can be studied 
via standard tools for comparing probability densities, in particular via 
the so called Girsanov formula for Markov processes. For our context, 
the density of one path-space measure over a time T, starting at 
probability law /i, with respect to another one Vp, is given by 

dVp fi{xo) I- Jo X{xt-,Xt)J 

(2.5) 

where u = {xt)Q,Xt G fi, is a piecewise constant trajectory (or path) 
with, as first integral in the exponent 

the escape rates, and with the last sum in the exponent being over the 
jump times t where the path takes Xt to Xt+- As a convention, we al- 
ways take right-continuous versions of the trajectories. As usual with 
probability densities, there is the assumption of absolute continuity 
making the undefiniteness not worse than giving weight zero to terms 
of the form 0/0. Mathematical details and derivation can be found in 
e.g. Appendix 2 of [9]. 
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That is useful for our fluctuation theory as we can obtain the prob- 
ability of an event as the density of the original process with respect 
to a new process which makes the event typical, conditioned on that 
event. That is sometimes referred to as the Cramer-trick in the theory 
of large deviations; a gentle introduction is contained in [22] . 

Remark that the exponent in (12. 5p contains two terms, the first 
one (with the escape rate) is time-symmetric, the second one is time- 
antisymmetric. In fact, soon we will see (in Sections 13.11 and 13. 4p that 
the time-antisymmetric part in the action governing the path-space 
distribution is exactly the entropy production. 

2.3. Relation to thermodynamics: local detailed balance. Up 

to here, we have only statistically defined our model. To get a physical 
(measurable) interpretation we should associate thermodynamics to it. 
In the case of equilibrium, this is well-known: by equilibrium we mean 
that case where 



a reversal symmetry for each of the transitions x ^ y, which finally 
amounts to the time-reversal symmetry of the stationary process. We 
restrict us here to state spaces for which the kinematical time-reversal 
is trivial (no velocities). That is a serious restriction, which is typi- 
cal for chemical reaction networks or for overdamped motion but one 
should understand that it greatly influences the relation between time- 
reversal, equihbrium and entropy production. 

For models of nonequilibrium systems, a thermodynamic interpre- 
tation becomes difficult because one expects that the condition of de- 
tailed balance (12. 6p is broken. What replaces it, is either derived from 
more microscopic models or is assumed. What guides that procedure 
is known as the condition of local detailed balance. For our purposes 
we can write it in terms of an energy function U{x) and a work func- 
tion (or driving) F{x,y) = —F{y,x) to assign rates to the transitions 
between each x and y, satisfying 



where /3 > is a parameter that stands for the inverse temperature of 
a reference reservoir. 

The fundamental reason for local detailed balance is the time-reversibility 
of an underlying microscopic dynamics over which our effective sto- 
chastic model is presumably built. Hence, violating such a condition 
reduces the physical interpretation of our stochastic model. As further 
explained in the next section, condition (12.70 is also intimately related 



where p{x) oc e 



■mix) 




Hx,y) 
X{y,x) 



^l3(F{x,y)+U{x)-U{y)) 
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to the symmetries of nonequilibrium fluctuations and to the role of 
entropy production in there. At any event, (12.71) allows to write 

Po{x)\{x,y)=^{x,y)e^^^^^y^ (2.8) 

with Po{x) = e~^'^^^^ /Z a reference equilibrium probability distribution 
and some symmetric 7(x, = 7(7/, x), which is left unspecified. To 
reveal the meaning of 7, notice that in equilibrium, i.e. for p = Po and 
F = 0, one has 2'y{x,y) = p{x) X{x,y) + p{y) \{y,x). The right-hand 
side is the expectation of the empirical observable 

rf (a;, y) = pf {x) fcf (x, y) + pf {y) kf{y, x) (2.9) 

that measures the time-symmetric dynamical activity (the total num- 
ber of jumps across the bond {x,y)) and we call it traffic. As we will 
see in Sections E] and 0, the traffic is a crucial quantity to characterize 
the nonequilibrium fluctuations far from equilibrium. 

3. Entropy production 

The notion of entropy production should not be fully re-invented 
when dealing with Markov jump processes. It must match with the 
thermodynamic or hydrodynamic interpretations. We start however 
with a view that goes beyond model-specifics and that emphasizes the 
relation with time-reversal. 

3.1. Statistical interpretation: time-irreversibility. Dynamical 
time-reversal plays on the level of single trajectories u = {xt)^ . We 
define the time-reversal as Ou = {xT-t)o, not indicating the trivial 
modifications at the jump times for restoring the right-continuity of 
paths. If we denote the original Markov process started at distribu- 
tion /i by Vfj,, then there is a time-reversed process Vfj,j,6 starting at 
the (time-evolved) distribution pT- There is a density of one with re- 
spect to the other, and that we call the (variable, fiuctuating) entropy 
production 

We can use the Girsanov formula (12.51) for its computation, see the 
details in [T7j. That formula (13.11) captures the idea of the entropy 
production as measuring the amount of time-reversal breaking. The so 
called fiuctuation theorem, steady or transient, time-dependent or not, 
very much rests on that unifying idea, [13]. For a foundation starting 
from the Hamiltonian dynamics and microcanonical ensemble, see [12] . 
We come back to fiuctuation relations in Section 13.41 
It is interesting to note that by convexity 

<s,T>, > 

as it should for an entropy production, where the brackets take the 
average with respect to V^, the path-space measure starting at p. 
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Being interested in an instantaneous (average) entropy production 
rate when the distribution is /i, we define 

so that, by the Markov property, = a{fit) dt with {nt)o the 

time-evolved measures. The instantaneous entropy production rate 
(T(/i) can easily be computed for our Markov process: 

The notation (xy) under the sum will from now on be used to mean 
that we sum over unordered pairs of states. 

The previous expressions do make physical sense even for a single 
Markov process defining a dynamics for a small finite number of degrees 
of freedom, thinking of an open system effectively coupled to and/or 
driven by large external reservoirs. It becomes however more physically 
transparent when formulated in terms of the empirical distribution as 
explained next. 

3.2. Thermodynamic interpretation. An open system dissipates 
heat that results in a change of entropy in the environment. Assuming 
a large environment we can compute it as the reversible heat. From 
the first law of thermodynamics that dissipated heat is identical to the 
work plus the change in internal energy. So, again in our ensemble- 
interpretation, the rate of change of energy is —J2xyjt^i^^y)^i^) 
with, see (12.31) . 

jf (x, y) = (x)A:f (x, y) - pny)k^iy, x) (3.4) 

being the empirical currents, and the power is Ylix y Jt^ v) -^(^i v)- 
therefore the empirical currents at time t equal j^{x, y) = j{x, y), then 
the dissipated heat is 

Q{j) = J2j{x,y){U{x) -U{y) + F{x,y)) (3.5) 

and the entropy current is PQ{j) (setting Boltzmann's constant equal 
to one) for an environment at temperature f3~^. 

Secondly, there is the change of the entropy of the system itself. Here 
we only have the densities (12.11) as macroscopic variable and 

Ssysip) = - ^p(x) \0gp{x) (3.6) 

X 

is the (static) fluctuation functional in the probability law for observ- 
ing the empirical density p when sampling the particles from the flat 
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distribution. Its change in time is the internal entropy production: 

Ssys{p,j) = j{x,y) {log p{x) - \ogp{y)) 

Summing it up, we get the total (macroscopic) entropy production rate 

Sip,j)^S,ysip,j)+PQ{j) (3.7) 

for the empirical values p and j for, respectively densities fl2.ip and 
currents (E 



3.3. Relating the two interpretations. Using the local detailed bal- 
ance condition (12.71) . the macroscopic entropy production rate in (13. 7p 
is 

= E ^')>°g (3.8) 

^ p{y)Ky^x) 

in terms of the instantaneous densities p{x) and currents 

j{x, y) = p{x)k{x, y) - p{y)k{y, x) 

Remember that p{x)k{x,y) is the fraction of particles that actually 
make the transition x ^ y, and j{x,y) is the (net) current of parti- 
cles. By the law of large numbers, the typical value of these currents at 
given densities p{x) is p{x)\{x,y) — p{y)\{y,x) and hence the typical 
entropy production rate (13. 8p just coincides with cr{p), see (13. 3p . This 
not only justifies our form of the local detailed balance assumption, it 
also explains the relation between the single Markov process formalism 
of Section 13.11 and the empirical description for an ensemble of the pro- 
cesses, cf. (I2.ip - (l2.2p : this duality is exploited throughout the whole 
text. 

A different decomposition that is equally useful (and used in the 
following subsection) writes 

Sip,j) = 5'cxt(j) + SintipJ) (3.9) 
for the entropy current 

S,Aj) = Y,3i^^y)F{x,y) (3.10) 
in excess with respect to the equilibrium reference, and 



S^n.ip,j) = J23{x,y)(logP^-logP^y^^ 



is now the rate of change of the system's entropy (always summing 
over pairs). Note that this decomposition differs only from the former 
(13. 7p in the use of another reference. In (13. 7p the reference is the flat 
distribution. To end this section we review two simple applications of 
the single process formalism of Section 13.11 
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3.4. Fluctuation relations. The decomposition (13.91) into the inter- 
nal and external change of the entropy can equivalently be done path- 
wise for a single process, starting from fl3.1l) . Note that it depends on 
the choice of the reference equilibrium process; using the notation Vo 
for such a reference started from a reversible measure po- Then (12. 5 p 
can be written in the form 



with the action A that can be read from (12.51) . Since the reference 
process is time-reversal invariant, we can now rewrite (13. ip as 



the (variable) entropy flux for a single chain, in excess with respect to 
the reference equilibrium process. Obviously, we also have 



which gives an exact (for all finite times T) symmetry in the distribu- 
tion of the (excess) entropy flux S'ext = ~Scy±9 at least when started 
from equilibrium. Steady fluctuation symmetries are then obtained as 
the asymptotics for T ] +oo. Note that in general one needs to deal 
with the temporal boundary term. However, in the present framework 
of ergodic Markov processes over a finite state space the dependence 
on the initial condition is irrelevant. 

The fluctuation symmetry (13. lip also has a formulation in terms of the 
macroscopic fluctuation theory within the ensemble formalism of the 
previous subsection; this will be discussed at the end of Section HUl 

3.5. Stationary measure. One may wonder how the above consid- 
erations are reflected on the level of the stationary distribution p it- 
self. That in fact is the subject of earlier work by Zubarev and by 
MacLennan, p.8j: what is a first order correction around a reference 
equilibrium/detailed balance, and is there a systematic perturbation 
theory? There are a number of ways to discuss that question. One 
possible direction is to try to formulate a variational principle for the 
p; this approach will be discussed later. Another, more direct approach 
is to compute the asymptotics T ] +oo of the time-evolved measure pt 
or, equivalently, to project the path-space distribution Pj on the time 
T, again asymptotically. As explained in a recent preprint, [10], the 





That corresponds to the decomposition (13. 9p and we call 





(3.11) 
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latter approach can be conveniently started from the fluctuation sym- 
metry (13 .111) . Indeed, by taking /{u) = x[^t = x] exp(— S'ext('^)/2), 
one has f9{ui) = x[xo = x] exp(S'cxt(^^)/2) and therefore 



x\xt = x\(i-:f.^{^ = i^\xQ = x\ Qy.^{^ 



Pj.i^r^.)^pJ.) ^^^£'- (3.12) 



po \ \ Z, / ' po 

As a consequence, the probability to see x at time T when started from 
reference equilibrium po is 

Xj'=X, po 

where we have to condition on the flnal-time event xt = x in the 
denominator. The ratio is one for the equilibrium dynamics, and the 
nonequilibrium correction is made by the time-asymmetry in the fluctu- 
ations of the entropy production. An advantage of this representation 
of the evolved measure lies in the cancelation of various nontransient 
(i.e. unbounded upon T growing) terms when expanding the exponents, 
so that the limit T | +oo can be controlled, see for more details. 



4. Dynamical fluctuations 



In the ensemble picture, trajectories u 



N 



[X 



t ' 



,x 



t )t 



have their 



coarse-grained counterparts in the empirical distributions {p^)t and the 
empirical rates {k^)t- They fluctuate around their typical values p and 
A, the typicality being in the sense of a law of large numbers with N as 
the large parameter. Computing the probability of the event = Pt, 
= kt for all < t < T is done via the Girsanov formula (12.51) . 
by comparing the system with modifled dynamics (such that pt and kt 
are typical) with the original system. Clearly, a macroscopic trajec- 
tory {pt, kt)t satisfying the consistency condition (12.31) becomes typical 
under the modifled (time-inhomogeneous) Markov dynamics with the 
rates {kt)t and the initial measure Pq. Its probability with respect to 
the original i.i.d. Markov processes x^, . . . started each from the 
distribution /i has the large deviation form 



Pt, kf = kt)o<t<T} = exp<! -A^ 



S{po\P')+ I dth{pt,. 





where = refers to the logarithmic equivalence as A^ 
relative entropy S and the Lagrangian L are 



'5(po l/i) = ^Po{x) log 



Po[x) 
/i(x) 



(4.1) 

oo, and the 

(4.2) 



L(p, A;)= ^ pix) k{x,y)\og 



X{x,y) 



k{x,y) + X{x,y) (4.3) 
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pN 



In particular, the Lagrangian on this level of description has a sim- 
ple explicit form, irrespective of any detailed balance or stationarity 
assumptions. It is therefore a natural point of departure for the inves- 
tigation of also more coarse-grained dynamical fluctuations. Next we 
consider one step of such a conceivable hierarchy. 

4.1. Lagrangian for currents. A quantity of special interest is the 
collection of empirical currents j^{x,y) = —j^{y,x) given in (13.41) . 
The Lagrangian C{p,j) that governs the joint occupation-current dy- 
namical fluctuations is 

= inf{L(p, A;) \ p{x)k{x,y) -p{y)k{y,x) = j{x,y); Vx,?/} (4.4) 

k 

where j is an arbitrary antisymmetric current matrix. The distribu- 
tion of empirical trajectories {pf ,j^)t follows from the large deviation 
law (14.11) via the contraction principle: 

{(pf =Pi,if = it)o<t<T} = exp|-A^ ^(po + ^ dtC{ptJt) I 

whenever the consistency constraint (12. 3p . pt{x) + J^y^x^ti^^ v) ~ 0; is 
satisfied. It can be made explicit by the method of Lagrange multipli- 
ers. One finds C{p,j) = L(p, y) where the k^ solve the equations 

F(x,t/) = A(x,y)e2'^'(^'J') (4.5) 
j{x,y) = p{x)k\x,y) -p{y)k\y,x) (4.6) 

for some specific ip^{x,y) = —i/j^{y,x), or explicitly, 

k^{x,y) = ■^^{j{x,y) + [f{x,y) + Ap{x)p{y)X{x,y)X{y,x)]^ (4.7) 

Hence, the typical macroevolution constrained by fixing the currents 
to some j becomes unrestrainedly typical by modifying correspondingly 
the antisymmetric part of the transition rates, as in (14.51) . 

From (14. 7p we check that p{x)y{x,y) = p{y)k^^{y,x). It is then 
straightforward to derive that 

C{p,-j)-C{p,j) = S{p,j) (4.8) 

so that the entropy production rate (13.81) is (indeed) the time-antisymmetric 
part of the Lagrangian. As a consequence, always in the logarithmic 
sense and in the limit t +oo, 

P^M=Pt,jl'=Jt)0<t<T} 



P^AiP^=PT-t,J^=-jT-t)o<t<T} 



exp[N[s{pT\fiT)-S{po\fi)]+ dtS{pt,jt)]] (4.9) 
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which is a macroscopic variant of the fluctuation relations described 
in Section Em 

4.2. Fluctuations of empirical time averages. Instead of looking 
at the probabilities of specific macroscopic trajectories of the system, 
we now consider empirical time averages: 

= ^ dt, = 1 ^^-f dt (4.10) 

For a fixed initial distribution /i, the asymptotic (T ] +oo) probability 
that the empirical time averages are equal to some density p and current 
3 is 

P7{pT=Pd?=j} = e-''^^^'^^^ (4.11) 
with the rate At given by 

At{p,3) = inf {Sipo I /i) + / dtC{pt,jt) Pt = pJt = j} (4.12) 

where the infimum is over all macrotrajectories {pt, jt)o<t<T such that 
Pt{x) + YliyjLxit^^^y) ~ ^- '^^^ infimum in fl4.12p is easy to compute 
in the limit of infinite time span, T | +cxd, in which the minimizing 
trajectory becomes essentially constant, {pt,jt)t = {p,j), and the initial 
distribution loses its relevance. One obtains AT{p,j) = T C{p,j) + 
o(T), yielding 

= P, = j} = e-^^^(^'^) (4.13) 

whenever the currents are stationary, "^y^^Jix, y) = 0. The equality is 
meant in the logarithmic sense and after taking first the limit N | +oo 
and then the limit T | +oo. For details on these manipulations and 
techniques from the theory of large deviations, we refer to [H El El El [22] • 

It thus appears that the Lagrangian C of (14. 41) - (14.71) governs the joint 
steady statistics of time-averaged occupations and currents. Its study 
has already been started in [I5||16j, emphasizing a canonical structure. 
As it is fully explicit, one can use it as variational functional to char- 
acterize the steady state, and for further contractions to obtain vari- 
ational functionals for the occupations and currents separately. That 
is however not the subject of the present paper. What comes in the 
sequel is an analysis of the structure of the above Lagrangians in the 
quadratic approximation and its physical consequences. 

5. Structure of Normal fluctuations 

The most accessible fluctuations are small — both mathematically 
and practically. The Lagrangians can be expanded in both the densi- 
ties and currents around their typical (= steady) values and the strictly 
positive quadratic form obtained in the leading order describes normal 
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fluctuations. From a physical point of view, the structure of these nor- 
mal fluctuations have been first analyzed by Onsager and Machlup, 
[in], for the case of relaxation to equilibrium. Here we show a natural 
extension of the original Onsager-Machlup formalism to nonequilibrium 
systems by starting from the above macroscopic fluctuation theory. 

We distinguish the two following scaling regimes: first, we analyze 
the nonequilibrium fluctuations in the immediate vicinity of a reference 
equilibrium through the scaled Lagrangian 

L''{u,j-F) = \ime''C{po + epoU,ej-eF) (5.1) 

where we have explicitly denoted here the dependence on the work 
function F as it quantifies the distance from equilibrium and partici- 
pates in the scaling. The Lagrangian corresponds to the dynamics (12. 8 p 
with some 7, po, and (3 fixed. 

Second, we consider a steady state arbitrarily far from equilibrium and 
examine the structure of small deviations through the function 

L(t;, j; F) = lim e'^Cip + epvj + ej; F) (5.2) 

ej.0 

Note that the work function is kept fixed here and both the density and 
current are expanded around the stationary values p respectively j. We 
will see below how the structure of fluctuations remarkably changes in 
this regime. 

5.1. Close to equilibrium. Starting from the dynamics with transi- 
tion rates parameterized as in (12. 8p . X{x,y) = p^^^x) 'y{x,y) e^^^^'y\ 
the scaled Lagrangian (15. ip is easily computed from (l4.4p -( Hr7j) : 

L^{u,j;F) = } {j{x,y)-j{x,y)[u{x)-u{y) + pF{x,y)]y 

(5.3) 

where we have introduced the scaled entropy production, cf. (13. Sp . 



{u) - S[U,J, 



s{uj)=\ime '^S{po + epoU,ej;eF) 

= ^j{x,y)[uix) - u{y) + pF{x,y)] ^^'^^ 

and the pair of (variant Onsager-Machlup) dissipation functions 



(5.5) 
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and 

= Y,i{x,y)[u{x)-u{y)+l3F{x,y)f (5.6) 

In contrast with the equihbrium Onsager-Machlup theory, [19] , we keep 
here the currents j as the variables of the Lagrangian. 

Fixing some m, the typical current minimizes the Lagrangian, 
which has the immediate solution 

f{x, y) = 7(x, y) [u{x) - u{y) + f3F{x, y)] (5.7) 

That variational problem for j", i.e. |'P(j) — s{u,j) = min, is known 
as the Onsager least dissipation principle. Equivalently, it is sometimes 
formulated as a transient maximum entropy production principle: the 
j'** solves s{u,j) = max under the constraint T>{j) = s{u,j). 

One checks that the dissipation function S{u) is a scaled version of 
the mean entropy production rate 03.31] : 

£{u) = hme~^cr(po + epo^; ^F) (5.8) 

where F again enters via the parametrization of the rates (12.81) . This 
is in accord with the equality 

s{u,r)=S{u) = V{r) (5.9) 

following from (15. 3p . 

The consistency condition (12. 3p determines the typical macroscopic 
trajectory as a solution of the equation 

Poix)^^ + J2ri^,y) = o (5.10) 

for all X, with j" the typical current (15. 7p . In particular, the stationary 
distribution p = po + eu + o(e) is in this scaling limit found from the 
(linearized version of the) Master equation 

J^li^^vMx) - uiy)+PF{x,y)] = (5.11) 

that has to be solved under the normalization constraint J2x Poi^) '^i^) = 
0. Alternatively, the (linearized) stationary density u and the cor- 
responding steady current j = j" can be found by minimizing the 
Lagrangian (15.30 subject to the stationary constraint Yliy^xi^-'^^y) ~ 
0. Note a remarkable simplification: because of this constraint, the 
entropy production (15.40 equals s{u,j) = P'^^^y-j j{x,y) F{x,y) and 
hence it is independent of u. As a consequence, the density and cur- 
rent become decoupled in the Lagrangian (15. 3p . By the arguments 
of Section 14.21 this means that the time-averages pT and Jt are un- 
correlated in the close-to-equilibrium regime and within the quadratic 
approximation. An immediate consequence of this observation is a 
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simple structure of the marginal distributions of u respectively j that 
provides a fluctuation-based justification of the two familiar stationary 
variational principles — the minimum and the maximum entropy pro- 
duction principles — as we explain next. See [TU |2l [ISl [IS] for some 
more details and illustrations. 

MinEP principle. We consider the marginal distribution of the empir- 
ical time-average defined in f l4.10p . By (14.131) and in the present 
scaling limit the asymptotic law of reads 

— lime~^ lim lim log P^'"^|pt = Po + ePo^^l 

eiO TT+ooATT+oo 



inf 



[L\u,3-F)\Y,3{x,y) = Q] (5_^2) 
= \[S{u)-S{u)\ 

where the last equality follows from (15.91) by using the decoupling be- 
tween u and j under the stationary constraint. The minimum entropy 
production principle immediately follows: £{u) > £{u) with the equal- 
ity only if u = M, hence, the stationary measure minimizes the entropy 
production rate, cf. (15. Sp . 

MaxEP principle. We proceed analogously for the time-averaged em- 
pirical current (14.101) . For any j satisfying the stationary condition 
J^xyji^^y) = we have by the contraction principle from (14.131) : 

-lime-2 hm lim logP^'^fj^ = ej} = ini L'iu,j; F) 

Irl 1 1 (^-^3) 

(Remember that s is independent of u under the stationary condition.) 
Restricting the set of currents even further by imposing the condition 
Vi^j) = s{j), the above equals 

mB = \ [m - m] = \ m - m (5.14) 

This in particular yields that the stationary current maximizes the 
entropy production rate under the above two constraints, which is an 
instance of the stationary maximum entropy production principle. 

5.2. Far from equilibrium. As we have seen the most remarkable 
feature of small fluctuations in the close-to-equilibrium regime is that 
the empirical distributions of occupations and of currents become un- 
correlated. This appears to be the fundamental reason for the en- 
tropy production principles discussed in the previous section to be 
valid. An important novel feature of the nonequilibrium statistics be- 
yond the close-to-equilibrium regime is that both empirical observ- 
ables get coupled as we can demonstrate via the other scaling limit 
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introduced in fl5.2p . There we do an expansion up to leading order 
around the stationary density p and the corresponding stationary cur- 
rent j{x,y) = p{x)X{x,y) — p{y)X{y,x); recall that F and hence the 
rates X{x,y) remain fixed now. Using also the notation 

rix, y) = pix)X{x, y) + piy)X{y, x) (5.15) 

for the steady traffic, the scaled Lagrangian (15.21) obtains the form: 



L{v,r,F)=\ime-^Cip + epvJ + er,F) 



(5.16) 



with the notation V^f (x,?/) = |[f(x) ± v{y)]. This is the Lagrangian 
describing normal ffuctuations around the typical evolution, with fV~f + 
jV^v being the typical (or expected) first-order deviation from the 
steady current j. We see that the steady traffic f plays the role of a 
variance in this fiuctuation law. 

In the stationary regime, i.e. under the constraint J2y=^xK^^y) = O5 
the Lagrangian (15.161) yields the rate function for the joint distribution 
of time-average occupations and currents, cf. (14.131) . We can write it 
in the form 



which demonstrates that the emerged occupation-current coupling is 
proportional to the stationary current and indeed vanishes only close 
to equilibrium when moreover j = 0(e). 



6. Towards a more general theory 



Adding a nonequilibrium driving not only generates nonzero steady 
currents but it also modifies the steady averages of time- symmetric 
observables and their fiuctuation statistics. For a long time, the latter 
has not been of primary interest in transport considerations, partially 
because of the success of linear response theories in which only the 
currents and the entropy production play a fundamental role. The 
origin of that has been discussed in Section 15.11 on the structure of 
close-to-equilibrium normal fiuctuations in which the time-symmetric 
and the time-antisymmetric sectors become totaly decoupled. Their 
coupling away from equilibrium, cf. Section 15.21 suggests that some 
systematic and robust description of nonequilibrium fiuctuations might 
be achieved by analyzing the time-antisymmetric (currents) and the 
time-symmetric (e.g. the occupation times) observables simultaneously; 
this is exactly the strategy brought up in the present paper. 
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6.1. Traffic. An important drawback of the transport theories based 
on stochastic models is that we only have a direct thermodynamic 
interpretation for the time-antisymmetric part of the transition rates, 
cf. the local detailed balance condition fl2.7p . whereas rather little can 
generally be said about the symmetric part and its dependence on 
the nonequilibrium driving. Yet, the fluctuation theory can help also 
here: instead of giving an interpretation to the symmetric part of the 
rates, one can try to understand the role of the traffic flS.lSp as a time- 
symmetric dynamical observable and a counterpart to the current. We 
have already seen that in equilibrium the (mean) traffic coincides with 
2'y{x,y), and away from equilibrium it enters, according to fl5.17p . as a 
variance for normal dynamical fluctuations. More generally and even 
beyond the regime of normal fluctuations, it can be shown that the 
dependence of the traffic on the driving fully determines the structure 
of nonequilibrium fluctuations in the time-symmetric sector, and also 
specifies the symmetric-antisymmetric coupling in a canonical way, flbl 
[16] . We give here a brief review of this approach. 

The Lagrangian C introduced in (14. 40 - (14. 7p has the form 

^PJ) = ^Pix)[k\x,y)ip\x,y) - k^{x,y) + X{x,y)] (6.1) 
x,y 

with the modified rates given by (14. 5p : they can be thought of as 
the original rates but with the modified work function F ^ F + ip^ 
fixed so that the current j becomes typical, 

j{x,y) = p{x)k\x,y) -p{y)k\y,x) (6.2) 

Therefore, 

^PJ) = ^[j{x,y)^P^{x,y) -rp^F+i,^{x,y) + Tp^F{x,y)] (6.3) 

with the (mean) traffic 
rp,G = p(x)Ag(x, y) + p{y)XGiy, x), X^x, y) = Xo{x, y) e^^^^^y'^ 

considered here as a function of the work matrix G\ the Ao(a;,?/) = 
p~^(x)7(a;, I/) being the rates corresponding to the reversible reference 
dynamics G = 0, cf. (12. 8p . Note that A^r+^j = y under the rela- 
tion (16. 2p : in fact the driving and the current appear to be conjugated 
variables in the sense of a canonical formalism, see [T3] for details. 

Clearly, (16.30 splits in two parts: the ffist term is to be understood 
as an excess of entropy production and the second one is an excess 
of overall traffic. Starting from this general scheme, we can calculate 
the fluctuation rate functions of arbitrary more coarse-grained dynam- 
ical observables. If that observable is purely time-symmetric, e.g. only 
depends on the occupations, then the excess is in fact a gradient, 
ip^{x, y) = V{y) — V{x) for state function V, and the ffist entropy pro- 
duction term in (16. 3p vanishes for currents satisfying the stationarity 
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condition '^y^,^. j{x,y) = 0. Then, what remains is the excess traffic as 
variational functional 

6.2. Why does the entropy production govern close-to-equilibrium? 

By construction the traffic functionals are quite different from the en- 
tropy production functionals. Yet, close to equilibrium the excess of 
traffic and the excess of entropy production are related to each other in 
a simple way: analogously to the scaled mean entropy production (15.81) . 

Sp{u) = lime^^cr(po + ^PoU] eF) (6.4) 

we consider the scaled overall traffic 

'^f{u) = lime"^ ^[rp„+,p„„.,^(a;,?/) - Tp^+ep„u;o{x,y)] (6.5) 

(relatively with respect to the equilibrium reference so that the limit is 
well defined), and we find the relation 

Tf{u) = ^[Sf{u)-So{u)] (6.6) 

Hence, close to equilibrium the mean overall traffic is determined by the 
mean entropy production. This observation remarkably simplifies the 
structure of Lagrangian (16.11) . and it finally leads to the (generalized) 
Onsager-Machlup theory of Section ISTTl in which the entropy production 
and derived quantities are the only players. 

To summarize, we understand the dominance of entropy produc- 
tion and the simple structure of the close-to-equilibrium regime as a 
consequence (1) of the decoupling of the time-symmetric and the time- 
antisymmetric fluctuations, (2) of the relation between the mean traffic 
and the mean entropy production in this regime. 

6.3. Beyond entropy production far from equilibrium. In a far- 
from-equilibrium regime the time-symmetric and the time-antisymmetric 
fluctuations get coupled and the relation (16. 6p is no longer valid. This 
gives a motivation why it is natural to study both dynamical sectors 
jointly. As we have seen, the entropy production alone is not suffi- 
cient to describe fluctuations in either of these sectors, and the traffic 
functional enters as a new important player in the nonequilibrium fluc- 
tuation theory. We hope that more theoretical investigation and also 
experimental evidence will support this line of research. 
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